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Abstract 

We study the reliability of phase oscillator networks in response to fluctuating inputs. Re- 
liability means that an input elicits essentially identical responses upon repeated presentations, 
regardless of the network's initial condition. In this paper, we extend previous results on two- 
cell networks to larger systems. The first issue that arises is chaos in the absence of inputs, 
which we demonstrate and interpret in terms of reliability. We give a mathematical analysis 
of networks that can be decomposed into modules connected by an acyclic graph. For this 
class of networks, we show how to localize the source of unreliability, and address questions 
concerning downstream propagation of unreliability once it is produced. 
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Introduction 

This is a sequel to Reliability of Coupled Oscillators I f2\\. but can be read independently (if the 
reader is willing to take a few facts for granted). Both papers are about the reliability of coupled 
oscillator networks in response to fluctuating inputs. Reliability here refers to whether a system 
produces identical responses when it is repeatedly presented with the same stimulus. The context 
in this paper is that of heterogeneous networks of coupled phase oscillators. The stimuli, or input 
signals, are assumed to be white noise; they are received by some components of the network and 
relayed to others with or without feedback. 

There has been substantial progress in understanding the reliability of single oscillators [|30ll25l 
|45l [371 |33l|28l[T7l [Hill. Paper I contains a detailed study of reliability properties for the simplest 
possible network, that of two coupled cells f2T\. We showed that this small network displays both 
reliable and unreliable behaviors in broad parameter ranges. Here, we consider larger networks 
building on some of the insight gained from Paper I. 

Our first observation concerns intrinsic network chaos, meaning the network in question can 
be chaotic even in the absence of any inputs. This phenomenon occurs only in systems consisting 
of 3 or more oscillators, and the chaos can be sustained in time and ubiquitous in the phase space. 
Its implications are discussed in Sects. 2 and 6. 

Our main technical analysis is in Sect. 3. It is first carried out for acyclic networks, that is, 
networks whose coupling connections have no cycles, and then extended to a larger class obtained 
by replacing the nodes in acyclic networks by modules (which are themselves networks). It is at 
this latter class that much of the discussion in the rest of the paper is aimed. 

In a larger network, there is a need to understand the problem locally as well as globally: when 
unreliability occurs, it is useful to know where it is created and which parts of the network are 
affected. Therefore, instead of solely using a single index, namely the largest Lyapunov exponent 
Amaxj as indicator of reliability for the entire system, we have sought to localize the source of 
unreliability, and to devise ways to assess the reliability of outputs registered at any given site. 
Among our findings is that once produced, unreliability propagates; no site downstream can then 
be completely reliable. 
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Figure 1 : Schematic of a forced oscillator network. 

In studying networks that decompose into smaller modules, there is a reassembly issue, namely 
how the information gained from studying the modules separately can be leveraged in the analysis 
of the full network. We will present some evidence to show that such a strategy may be feasible. 

Numerous examples are given to illustrate the ideas proposed. In addition to the 2-oscillator 
system studied in [|2T|. we present a few other examples of small networks capable of both reliable 
and unreliable behavior, finding some rather curious (and unexplained) facts along the way. 

The mathematical analysis in Sect. 3 is rigorous, as are the facts reviewed in Sects. 2.2 and 
4.1. The rest of the investigation is primarily numerical, supported whenever possible by facts 
from dynamical systems theory. In the course of the paper we have highlighted a number of 
observations, based in part on empirical data, that are directly relevant for the broader theoretical 
questions at hand. 

There is a vast literature on networks of oscillators; it is impossible to give general citations 
without serious omissions. We have limited our citations to a sample of papers and books with 
settings closer to ours or which treat specifically the topic of reliability (see below). We mention 
in particular the recent preprint [|36ll . which discusses the reliability of large, sparsely coupled 
networks in a way that complements ours. 

1 Model and measure of reliability 
1.1 Coupled phase oscillator systems 

We consider in this paper networks of coupled phase oscillators in the presence of external stimuli. 
A schematic picture of such a setup is shown in Figure [TJ The networks considered are of the type 
that arise in many settings; see e.g., i30l[34l[l9l[T4l|42l[32l[3l[5ir7|. 



3 



The unforced systems, i.e., the systems without external stimuli, are described by 

Oi = uJ^ + z{ei) aji giQj) , i = 1, ■ ■ ■ , . (1) 

In this paper, can be any number > 1; in particular, it can be arbitrarily large. The state of 
oscillator % is described by an angular variable Qi ^ = M.jTL.i = 1, - ■ ■ ,N. Its intrinsic 
frequency is given by a constant cui. We allow these frequencies to vary from oscillator to oscillator. 
The second term on the right represents the coupling: aji G M, (7 is a "bump function" vanishing 
outside of a small interval (—6,6); on {—b,b), it is smooth, > 0, and satisfies J^^g{6) dO = 1; 
z{9) is a function which in this paper is taken to be 2; (6*) = ^(1 — cos(27r6')). The meaning of this 
coupling term is as follows: We say the jth oscillator "spikes" when 9j{t) = 0. Around the time 
that an oscillator spikes, it emits a pulse which modifies some of the other oscillators [|29l [351 |T3] 
l27l . The sign and magnitude of aji describe how oscillator j affects oscillator i: aji > (resp. 
ttji < 0) means oscillator j excites (resp. inhibits) oscillator i when it spikes, and aji = means 
oscillator i is not directly affected. In this paper, 6 is taken to be about ^, and the aji are taken to 
be 0{1). Finally, the function z{9), often called the phase response curve ll4Tl[m [6l[T9ll, measures 
the variable sensitivity of an oscillator to coupling and stimulus inputs. 
The stimulus-driven systems are of the form 

dOi = ujidt + z{ei) aji giOj) dt + /^(t)) , 

Ii{t) = dWi{t) , i = l,---,N. (2) 

Here, Ii{t) is the external stimulus received by oscillator i; it is taken to be white noise with ampli- 
tude ej. For simplicity, we assume that for i 7^ j, dWi{t) and dWj{t) are either independent, or they 
are one and the same, i.e., the same input is received by both oscillators although the amplitudes 
may differ. As discussed earlier, we are primarily interested in situations where inputs are received 
by only a subset of the oscillators, with ej ^ for the rest. Likewise, we are sometimes interested 
in the response registered at only a subset of the oscillators rather than the whole network. See 

Fig.m 

For more on the motivation and interpretation of this model, see Sect. 1.2 of [2T|. 

1.2 Lyapunov exponents as indicator of reliability 

Reliability in this paper refers to the following: Suppose the stimuli in Eq. ([2]) described by the 
terms eili{t) are turned on at time t = 0. Will the response of the system depend on the initial 
state of the system when the stimuli are presented? That is to say, let ©(t) be the solution of 
Eq. To what degree does ©(t) depend on 0(0) after some initial period of adjustment? If 
the dependence on ©(0) is negligible after a transient, we think of the system is reliable; and if 
different ©(0) lead to persistently different responses at time t for all or most t, we say the system 
is unreliable. Needless to say, the lengths of the transient and the degree to which the responses 
differ are important in practical situations, but these issues will not be considered here. 
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The measure of reliability used in a good part of this paper is Amax^ the largest Lyapunov 
exponent of the system. We briefly recall here the meaning of this number and its relation to 
reliability as discussed above, referring the reader to [1, 2J for background material on stochastic 
flows and to Sect. 2 of [,21 J for a more detailed discussion of how this material is used in the study 
of reliability. 

We view Eq. Q as a stochastic differential equation (SDE) on = x ■ ■ ■ with phase 
variables (^^i, ■ ■ ■ , 9]^). A well known theorem gives the existence of a stochastic flow ofdiffeo- 
morphisms. That is to say, for almost every realization u of white noise, there exist flow maps of 
the form Ft^^t^.^: here ti < t2 are any two points in time, and Ft-^^t2;uj{G{ti,Lu)) = &{t2, uj) where 
0(t, uj) is the solution of ^ corresponding to to. By the Lyapunov exponents of Eq. we refer 
to the Lyapunov exponents of F^ t.^ as t increases. These numbers do not depend on cu; and they 
do not depend on 0(0) if Eq. (O is ergodic (which it often is). The largest Lyapunov exponent is 
denoted by Amax- 

In 1*211, cf- [l33l l9l[T7l. we used of Amax as a measure of reliability. Specifically, Amax < is 
equated with reliability, Amax > represents unreliable behavior, and Amax = is inconclusiveQ 
These criteria will continue to be used in this paper. 

To understand why Amax is a reasonable indicator of reliability, recall the idea of sample mea- 
sures: if we let fi denote the stationary measure of Q, i.e. the stationary solution to the Fokker- 
Planck equation, the sample measures are then the conditional measures of /x given the past history 
of the stimuli. More precisely, if we think of uj as defined for all t E (— oo, oo) and not just for 
t > 0, then fi^ describes what one sees at t = given that the system has experienced the input 
defined by cu for all t < 0. Sample measures thus give an approximation of what one sees in 
response to an input presented on a time interval [—to, 0) for large enough to > 0. If we let at 
denote the time-shift of the Brownian path cu, then sample measures evolve in time according to 
(-^o,i;w)*/^a; = f^'atuj- As explained in [f2T]| , if stimuli corresponding to a realization to are turned 
on at t = 0, then gives a good approximation of the responses of the system at sufficiently 
large times t for an ensemble of initial conditions sampled from a smooth density. In particular, if 
/io^j^ collapses down to a single point as t increases, then we conclude that initial conditions have 
little effect after transients, i.e. the system is reliable. If fi^^^ is spread out nontrivially in the phase 
space, and this condition persists with t, then we conclude that different initial conditions have led 
to different responses at time t, which is exactly what it means for the system to be unreliable. 

The relation between sample measures, which represent a collection of the system's possible 
responses, and Amax» its top Lyapunov exponent, is summarized in the following general result 
from dynamical systems theory. 

Theorem 1. Consider a SDE with an ergodic stationary measure /i. 

(1) ^W[l TjfAmax < 0, then with probability 1, fi^ is supported on aflnite set. 

(2) l[2U^ If fi has a density and Amax > 0, then with probability 1, /i^ is a random SRB measure. 

Case (1) is often referred to as the system having random sinks. When Amax < 0, in the vast 
majority of situations is supported on a single point; we therefore equate it with reliability as in, 

'We note that there are other ways to measure unreliability which seem to us to be equally reasonable. For example, 
one can take the sum of all positive Lyapunov exponents. 
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e.g., [[33ll28l . In Case (2), the system is said to have a random strange attractor. For deterministic 
systems, SRB measures are well studied objects with a distinctive geometry: they have densities 
on (typically) lower dimensional surfaces that wind around the phase space in a complicated way; 
see [4J. Here we have a random {i.e. cj-dependent) version of the same picture. Thus the resulting 
geometry is a readily recognizable signature of unreliability. 

Finally, we remark that Amax is a global indicator of unreliability, meaning a positive expo- 
nent will tell us only that the network possesses some unreliable degrees of freedom: it does not 
specify where this unreliability is produced, whether its effects are localized, and so on. Different 
measurements are needed to answer these more refined questions. They are discussed in Sects. 



2 Intrinsic network chaos 

2.1 Chaotic behavior in undriven networks 

This section discusses an issue that did not arise in [|2ll- Our criterion for unreliability, Amax > 0, 
is generally equated with chaos. In the 2-oscillator network studied in [|2T1l . this chaotic behavior 
is triggered by the input: without this forcing term, the system cannot be chaotic as it is a flow on 
a two-dimensional surface. The situation is quite different for larger networks. 

Observation 1: Networks of 3 or more pulse-coupled phase oscillators can be chaotic in the 
absence of any external input. 

We begin by explaining what we mean by "chaotic." It is well known that systems of 3 or more 
coupled oscillators without external input can have complicated orbits, such as homoclinic orbits 
or horseshoes (see, e.g., ||3T1 l27ll . and also lfT2l [5l for general references). These special orbits 
by themselves do not necessarily constitute a seriously chaotic environment, however, for they are 
not always easily detectable, and when horseshoes coexist with sinks, the chaotic behavior seen 
is transient for most choices of initial conditions. We claim here that networks with 3 or more 
oscillators can support a stronger form of chaos, namely that of strange attractors. There is no 
formal definition of the term "strange attractors" in rigorous dynamical systems theory. An often 
used characterization is the existence of SRB measures or physical measures, which describe the 
long-time distribution of orbits starting from positive Lebesgue measure sets of initial conditions 
(H |43l im. At a minimum, one would insist that positive Lyapunov exponents be observed for 
almost all - or at least on a large positive Lebesgue measure set - of initial conditions. (In the case 
of horseshoes coexisting with sinks, for example, Lyapunov exponents for most initial conditions 
are negative after a transient.) In numerical simulations, one has to settle for positive Lyapunov 
exponents that are sustained over time for as many randomly chosen initial conditions as possible. 
This will be our operational definition of intrinsic network chaos. 

One of the simplest configurations that support intrinsic network chaos is 
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The setup above is similar to that studied in [2T|, except that the (2,3)-subsystem is kicked peri- 
odically by pulses from oscillator 1 rather than driven by an external stimulus in the form of white 
noise. Ignoring the presence of oscillator 1 for the moment, we saw in [i2ril . Sect. 4.2, that when 

and 032 are roughly comparable and away from 0, the phase space geometry of oscillators 2 
and 3 is favorable for shear-induced chaos, a geometric mechanism for producing chaotic behav- 
ior. Indeed, a rigorous theory of this mechanism gives the existence of strange attractors with SRB 
measures when such a system is periodically kicked — provided the kicks are suitably directed 
and time intervals between kicks are sufficiently large [|39l|40 1. Even though the kick intervals (of 
^1) here are too short for rigorous results to be applicable, numerical simulations show that there 
are definitively positive exponents sustained over long periods of time when ai2 is large enough. 

As an example, consider system ([3]) with uji,uj2,ujs = 0.93,1,1.1, and 023,032 = 1,1-45. 
We find that Amax increases from about 0.025 to 0.12 for au G (1, 1.5)11 Notice that the system 
parameters above are chosen so that the (2,3)-subsystem is unreliable, that is, so that A^ax > 
when oscillator 2 receives a white noise stimulus: see [21], Fig. 12. It is, after all, the same 
mechanism, namely shear-induced chaos, that produces the chaos in both situations. See f,22,l . 
Study 4, for similar findings. 

While there are certainly large classes of networks that do not exhibit intrinsic network chaos 
(e.g. see Sect. [3]), from the example above one would expect that such chaos is commonplace 
among larger networks. Moreover, for intrinsically chaotic networks, one would expect Amax to 
remain positive when relatively weak stimuli are added to various nodes in the network. We have, 
in fact, come across a number of examples in which Amax remains positive for larger stimulus 
amplitudes. This raises the following issue of interpretation: In an intrinsically chaotic network 
that also displays Amax > in the presence of inputs, it is unclear how to attribute the source of 
unreliability, since the effects of inputs and intrinsic chaos are largely inseparable. We adopt here 
the view that whatever the cause, such a network is unreliable. 



2.2 Suppression of network chaos by inputs: a case study 

An interesting question is whether or not networks with intrinsic chaos of the form described above, 
i.e. with Amax > for large sets of initial conditions in the absence of inputs, necessarily respond 
unreliably to external stimuli. We find that the answer is "no": we have come across a number of 
instances where weakly chaotic networks are stabilized by sufficiently strong inputs. An example 
is in the following 3-cell ring: 




We find small regions of parameter space near 012 = 1, 023 = 2, 031 = 0.6 with intrinsic network 

^These Lyapunov exponents are computed starting from ^ 10 initial conditions and have an absolute error of 
roughly 0.005. 



7 




1.90 1,95 2.00 2.05 2,10 



Figure 2: Suppression of intrinsic chaos in Eq. (ITOl) . Left: the Lyapunov exponent Amax with e = is shown 
as a function of 023 and a^i (au is fixed at 1). Each exponent is computed using 4 initial conditions. For 
the vast majority (> 95%) of the points computed, the error in the computed exponent is < 0.005. Right: 
we show the response to e > for 023 = 2.075 and 031 = 0.6025. In all plots, we use lui = \,uj2 = 0.95, 
and 6<J3 = 1.1. 

chaos, as evidenced by positive values of Amax^ see Fig. Oa). As the reader will notice, Amax 
oscillates quite wildly in this region, with Amax > and Amax = occurring at parameter values 
in close proximity. This is characteristic of a large class of deterministic dynamical systems as we 
now explain. 

The phase space of system dH) is the 3-torus. Taking the section {Q\ = 0} of the e = flow, 
we obtain a return map ^ from the 2-torus to itself. There are well known examples of maps 
of the 2-torus that are uniformly hyperbolic; a case in point is the "cat map". These maps are 
robustly hyperbolic; it is impossible to destroy their positive Lyapunov exponents by reasonable- 
size perturbations. Our section map \E', however, cannot be of this type for topological reasons: 
it is not hard to see that ^ can be deformed continuously to the identity map by suitably tuning 
system parameters. Generally speaking, for 2-D maps that can be deformed to the identity, the only 
way to form strange attractors is by "folding". Such systems are at best nonuniformly hyperbolic; 
their observed Lyapunov exponents are the results of competing tendencies: there is expansion 
in the phase space, which necessarily leads to contraction elsewhere or in different directions, 
and the expanding and contracting directions are not separated as in the cat map. As a result of 
this competition, sustained, observable chaos, i.e., strange attractors, live side by side in parameter 
space with transient chaos, i.e., systems in which horseshoes and sinks coexist. The simplest family 
of examples exhibiting such a phenomenon is the logistic family ll23llT5l[T0l . This phenomenon 
also occurs in shear-induced chaos; see e.g., [1221 . For an exposition on nonuniformly hyperbolic 
systems, see e.g., [43 1. The mixed behavior alluded to above is discussed in, e.g. ["445. 

Thus even without explicit knowledge of the map one would expect to see a pattern of 
behavior similar to that in Fig. [2ta) when positive exponents are present. Here, Amax = for the 
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flow corresponds to \1/ having a Lyapunov exponent < 0, including the parameters with transient 
chaos. 

We now consider the effects of adding a stimulus, that is, taking £ > for system dH). Infor- 
mally, one may think of the stimulus as sampling nearby parameters, averaging (in a loose sense) 
the different tendencies, with chaos suppression made possible by the presence of the mixed be- 
havior. A sample of our numerical results is shown in Fig. [2tb). At e = 0, A^ax > 0, indicating 
network chaos. As expected, Amax remains positive for small e. But, as e increases, A^ax steadily 
decreases and eventually becomes mildly negative, demonstrating that sufficiently strong forcing 
can suppress intrinsic network chaos and make a network more reliable. A possible mechanistic 
explanation is that when e is large enough, oscillator 1 is affected more by the stimulus than by os- 
cillator 3 due to the relatively weak coupling 031. As in the case of a single oscillator, the stimulus 
has a stabilizing effect on oscillator 1, making it reliable. 

Our understanding from the discussion above may be summarized as follows: 

Observation 2: Some networks with weak intrinsic chaos will respond reliably to moderately 
strong stimuli. 

3 Acyclic networks and modular decompositions 

Since the possibilities in completely general networks are vast, we think a good place to start may 
be the class of acyclic networks. These are networks in which there is a well defined direction of 
information flow. We will show that acyclic networks are not intrinsically chaotic, and they are 
never unreliable. Building on the analysis developed for acyclic networks, we identify a broader 
class that may be accessible to analysis, namely networks that admit a decomposition into modules 
with acyclic inter-module connections. 

For simplicity, we assume throughout that the stimuli are independent; it is trivial to modify the 
results of this section to accomodate the situation when some of them are identical to each other. 

3.1 Skew-product representation of acyclic networks 

We first describe the connection graph that corresponds to an oscillator network. Let each node 
of this graph, i E {1, ■ " " ? N}, correspond to an oscillator. Assign a directed edge from node i to 
node j, i 7^ j, if oscillator i provides input to oscillator j, i.e. if 7^ 0; in this case, we write 
i ^ j. (For simplicity, we do not allow nodes to connect to themselves.) A cycle in such a directed 
graph is a sequence of nodes and edges ii 12 ■ ■ ■ ik ^ ii for some k > 1. 

Definition 3.1. We say an oscillator network is acyclic if its connection graph has no cycles. 

Given any pair of oscillators in an acyclic network, either they are "unrelated", or one is "up- 
stream" from the other. We say oscillator i is "upstream" from oscillator j if there is a sequence 
of nodes and edges that goes from i to j. The absence of cycles is precisely what makes this 
"upstream"-"downstream" notion well defined. We say oscillators i and j are "unrelated" if there 
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is no chain that goes from i to j or vice versa. Unrelated oscillators do not necessarily behave in- 
dependently: they may, for example, receive input from the same source. Overall, the structures of 
acyclic networks can still be quite complex, with tree-like branching and recombinations possible. 
Our first task is to find a systematic way to treat the dynamics within these networks. 

Lemma 3.1. In an acyclic graph, one can define for each node j a number m{j) representing its 
maximum number of ancestors, meaning 

(i) there is a chain of the form ii ^ 12 ^ ■ ■ ■ ^ im{j) j, ci^d 

(ii) there is no chain of the form ii ^ 12 • • ■ ^ im{j)+i j- 

The proof is simple: chains cannot be arbitrarily long without a node repeating, and such repeats 
are impossible in acyclic graphs. 

Using the notation of Sect. 1.1, we now discuss the dynamical structure of acyclic oscillator 
networks. First, let (ft denote the flow on in the absence of inputs, i.e., with Si = 0. We say 
(ft factors into a hierarchy of skew -products with 1 -dimensional fibers if after a permutation of the 
names of the oscillators, we have the following: For each A; = 1, ■ ■ ■ , A^, there is a vector field 
X^^^ on such that if Lp^^"^ is the flow generated by X'^^\ then (i) Lp^^"^ describes the dynamics 
of the network defined by the first k oscillators and the relations among them, and (ii) ^^^^^^ is a 
skew-product over ^pt\ that is, the vector field X^^^^^ on T^+^ has the form 

where {^(ei, -- .e^)} is a family of vector fields on parametrized by (6'i, ■ ■ ■ , 6*^) G T^. In partic- 
ular, ifl^'' In the system defined by Q, we refer to Lp^^'^ on as the flow on the base, and 
each copy of over T'^ as di fiber. 

Proposition 3.1. The fiow of every acyclic network of N oscillators with no inputs can be repre- 
sented by a hierarchy of skew -products with 1 -dimensional fibers. 

Proof: Let Mm be the set of oscillators j with m(j) = m. Assign an ordering to the oscillators 
so that all the oscillators in Aq come first, followed by those in A/i, then A/2, and so on. The 
order within each Mm is immaterial. Let us denote this ordering hy ii < 12 < ■ ■ ■ in- ^ skew- 
product is built inductively as follows: For k >\, consider the subnetwork consisting of oscillators 
zi, ■ ■ ■ ,ik. None of the oscillators < k, receives input from any of the oscillators i^, £ > k. 
(To see this, note that ii — > ij implies m{ij) > m{ii) by definition, but this is impossible under 
the ordering we have chosen.) Therefore, the dynamics of oscillators ii, ■ ■ ■ , as a subsystem of 
the entire network may be described by a vector field of the form X^'^\9i^, ■ ■ ■ ,9i^), obtained by 
projecting X^^^ onto these k coordinates. Starting with k = 1, the skew-products in the lemma 
are constructed inductively for increasing k. □ 

Next we generalize to acyclic networks with stimuli. Such networks can also be represented by 
a directed graph of the type described above, except that some of the nodes correspond to stimuli 
and others to oscillators. If i is a stimulus and j an oscillator, then ? — > j if oscillator j receives 
information directly from stimulus i. No arrow can terminate at a stimulus, so that m{i) = if i is 
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a stimulus. Clearly, a network driven by stimuli is acyclic if and only if the corresponding network 
without stimuli is acyclic. 

Proceeding to skew-product representations, consider first the case of a single oscillator driven 
by a single stimulus. Let denote the set of all Brownian paths defined on [0, oo), and let at : 
r2 ^ r2 be the time shift. Then the dynamics of the stochastic flow discussed in Sect. 2.1 can be 
represented as the skew-product on ^7 x S*^ with 

<l>t:(u;,a;) ^ (0-4(0;), Fo,j;<^(x)) . 

Similarly, a network of oscillators driven by q independent stimuli can be represented as a 
skew -product with base Qfl (equipped with product measure) and fibers T^. 

Proposition 3.2. The dynamics of an acyclic network driven by q stimuli can be represented by a 
hierarchy of skew-products over Qfl with 1 -dimensional fibers. 

The proof is identical to that of Proposition 13. 1[ except that when enumerating the nodes of the 
graph, we first list all of the stimuli (in any order) before listing the oscillators. 

3.2 Lyapunov exponents of acyclic networks 

Consider a network of N oscillators driven by q independent stimuli. We first review some no- 
tation. Let uj E VL'' denote a g-tuple of Brownian paths, and let Fq^^^ denote the corresponding 
stochastic flow on T^. For a fixed uj EQfl.x E and tangent vector v at x, define the Lyapunov 
exponent 

A^(x,f) = lim -log |Z:'Fo,t;<^(x)f I (6) 

t— >oo t 

if this limit exists. If /i is a stationary measure of the stochastic flow, then for a.e. uj and /i-a.e. x, 
\uj{x, v) is well defined for all v. The following is the main result of this section: 

Theorem 2. Consider a network of N oscillators driven by q independent stimuli, and let fj, be a 
stationary measure for the stochastic flow. Assume 

(a) the network is acyclic, and 

(b) /i has a density on T^. 

Then A^(x, v) < Ofor a.e. u E Q'^ and fi-a.e. x. 

One way to guarantee that condition (b) is satisfied is to set £i to a very small but strictly positive 
value if oscillator i is not originally thought of as receiving a stimulus, so that Si > for all i. Such 
tiny values of Si have minimal effect on the network dynamics. Condition (b) may also be satisfied 
in many cases where some = if suitable hypoellipticity conditions are satisfied, but we do not 
pursue this here [26J. 

Before proceeding to a proof, it is useful to recall the following facts about Lyapunov expo- 
nents. For a.e. to and /x-a.e. x, there is an increasing sequence of subspaces {0} = Vq C V^i C 
■ ■ ■ C Vr = and numbers Ai < ■ ■ ■ < such that A^(x, v) = Aj for every v G Vi\ Vi^i. The 
subspaces depend on to and x, but the exponents A^ are constant a.e. if the flow is ergodic. We call 
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a collection of vectors {vj} a Lyapunov basis if exactly dim(Vi) — dim(Vi_i) of these vectors 
are in V-i \ Vi^i. If {vj} is a Lyapunov basis, then for any u,v e {vj}, u v, 

lim ^ log I sin Z(DFo,j;^(x)m, DFo,t;^(x)f ) | = 0, (7) 

t^oo t 

that is, angles between vectors in a Lyapunov basis do not decrease exponentially fast; see e.g., 
[|43l for a more detailed exposition. 

Proof: Since the network is acyclic, it factors into a hierarchy of skew-products. The A;th of these is 
a stochastic flow Fq^.^ on T'^. It describes the (driven) dynamics of the first k oscillators assuming 
they have been reordered so that oscillator i is upstream from or unrelated to oscillator j for i < j. 
Let /i*^*^'' denote the projection of jj, onto T^. Then jj,^''^ is an stationary measure for F^f.^, and it 
has a density since /i has a density. We will show inductively in k that the conclusion of Theorem 
2 holds for 

For k = 1, Xu,{x, v) < for a.e. uj and fj,^^^-a..e. x. This is a consequence of Jensen's Inequality; 
see e.g., [[211, Sect. 2.2, for more detail. 

(k) 

Assume we have shown the conclusion of Theorem 2 up to k — 1, and view F^ p^ as a skew- 
product over n'' X T^^i with S^-fibers. Choose a vector Vk in the direction of the S^-fiber. Note 
that this direction is invariant under the variational flow DFq^^^ due to the skew-product structure. 
Starting with v^, we complete a Lyapunov basis {vi , ■ ■ • , tifc} at all typical points. Due to the invari- 
ance of the direction of Vk, we may once more use Jensen's Inequality to show that A^(x, v^) < 
for a.e. x and u). We next consider Vi with i < k. First, define the projection tt : T*' — >■ T'^"^, and 
note that 



sm/:{vk,DF^'^^^.^{x)vi 



Due to Eq. ([7]), we have Xuj{x, Vi) = limf^oo 7 log |7r(DFg'^?^(a;)fi)|. But the skew-product struc- 
ture yields 7r(DFQ^^^^(x)f j) = DFQ'^^7j'\TTx){TTVi), so by our induction hypothesis, A<^(x, Vi) < 0. 
□ 

Remarks on reliability of acyclic networks: Our conclusion of Amax < falls short of reliability, 
which corresponds to Amax < 0. When there are free-rotating oscillators in a network, i.e. oscil- 
lators that are not driven by either a stimulus or another oscillator, then clearly Amax = 0. When 
no free-rotating oscillators are present, typically one would expect Amax < 0. We do not have a 
rigorous proof, but this intuition is supported by numerical simulations. 

Arguments similar to those in the proof of Theorem 2 (but in the absence of stimuli and without 
the use of an invariant measure) give the following: 

Proposition 3.3. Acyclic networks are never intrinsically chaotic, in the sense that at Lebesgue- 
a.e.x G T^, all Lyapunov exponents (with lim sup instead of limit in Eq. ®j are < 0. 
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3.3 Modular decompositions and quotient systems 

We next describe how the reliability of more general networks may be analyzed by decomposition 
into subunits. Consider a graph with nodes {1, ■ ■ ■ , A^} as in the beginning of Sect. 13.11 and let ~ 
be an equivalence relation on the set {1, ■ ■ ■ , A^}. The quotient graph defined by ~ has as its nodes 
the equivalence classes [i] of ~, and we write [i] — > [j] if there exists i' E [i] and j' E [j] such that 
i' j'. The following is a straightforward generalization of Proposition 13.21 

Proposition 3.4. In a network of oscillators driven by q independent stimuli, if an equivalence 
relation leads to an acyclic quotient graph, then the dynamics of the network can be represented 
by a hierarchy of skew-products over VL^, with the dimensions of the fibers equal to the sizes of the 
corresponding equivalence classes. 

We pause to discuss in more detail the structure in Prop |3.4[ as it is important in the rest of 
this paper. An equivalence relation on the nodes of a network describes a decomposition of the 
network into smaller subunits called modules. Introducing directed edges between modules as 
above, we obtain what we call a quotient network in this paper. Assume this quotient network is 
acyclic, and let Mi, M2, ■ ■ ■ , Mp be the names of the modules ordered in such a way that Mj is 
upstream from or unrelated to M, for all j > i. Let kj be the number of nodes in module Mj. For 
Si = ki + k2 + ■ ■ ■ + ki, let F^\'Ij denote, as before, the stochastic flow describing the dynamics 

within the union of the first i modules; we do not consider Fq'^^^ when s ^ Si for some i. The 
dynamics of the entire network can then be built up layer by layer as follows: We begin with the 
stochastic flow -Fq^^^- Then proceed to F^^^^'^'^^\ which we view as a skew-product over -Fq 
This is followed by Fq^^^'^'^^''^\ which we view as a skew-product over Fq^^^'^'^\ and so on. 

Let \^^\ ■ • • , A^^^"* denote the Lyapunov exponents of -Fq Clearly, these are the Lyapunov 
exponents of a network that consists solely of module Mi and the stimuli that feed into it. We 
wish, however, to view Mi as part of the larger network. If AmL = maxj A^^"* > 0, we say 
unreliability is produced within Mi. An interesting question is the effect of this unreliability on 
sites downstream. Leaving this to Sect. 4, we continue with the present discussion: For i > 1, 
let A^ ■ ■ ■ , A^*'' denote the fiber Lyapunov exponents in the skew-product representation of -Fq 

over -Fq t'w^'*' ^^'^ Amax = maxj A^*-*. Then AmL > has the interpretation that unreliability is 
produced within module Mi as it operates in the larger network. It is important not to confuse this 
with the Lyapunov exponents of module Mi in isolation, an issue we will follow up in Sect. 6. 

Analogous interpretations for the zero-input systems are obvious: for i > 1, AmL > at e = 
means there is intrinsic network chaos within the module Mi as a subsystem of the larger system, 
and so on. 

The proof of the following result is virtually identical to that of Theorem 2: 

Proposition 3.5. Suppose for a driven network there is an equivalence relation leading to an 
acyclic quotient graph. Then, with respect to any ergodic stationary measure /i, the numbers 
X^j \ I < i < p,l < j < ki, are precisely the Lyapunov exponents of the network. 

Proposition 13. 5 1 says in particular that if, in each of the p skew-products in the hierarchy, the fiber 
Lyapunov exponents are < 0, i.e., if no unreliability is produced within any of the modules, then 
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Ajnax for the entire network is < 0. Conversely, if unreliability is produced within any one of the 
modules as it operates within this network, then Amax > for the entire network. On the practical 
level, the skew product structure (which implies that DF^ t-u is block-lower-triangular) and the 
Proposition together give a more efficient way to numerically compute Lyapunov exponents of 
networks with acyclic quotients. 

Important remarks. In the rest of this paper, we will often take the view that the network in 
question is equipped with a modular decomposition connected by an acyclic graph. Such a de- 
composition always exists for any network, but it can be trivial {e.g., when the entire network is a 
single module). If the decomposition is nontrivial and Amax > for the network. Proposition [33] 
enables us to localize the source of the unreliability, i.e., to determine in which module unrelia- 
bility is produced via their fiber Lyapunov exponents. In particular, modules that are themselves 
acyclic cannot produce unreliability. 

As noted earlier, the idea of "upstream"-"downstream" for acyclic networks extends to mod- 
ules connected by acyclic graphs, so that it makes sense to speak of a module as being downstream 
from another module, or a site as being downstream from another site, meaning the modules in 
which they reside are so related. 

4 Propagation of unreliability 

In this section, we address the following basic question: Under what conditions will unreliability 
generated in one part of a network propagate downstream? In Sect. 14.11 we discuss how to 
measure unreliability at specific network sites, and in Sect. 14. 2[ we address the question posed. 

4.1 Measuring reliability at individual network sites 

Often, it is the response of a network measured at specific oscillators (or sites) that is of relevance, 
rather than the response of the network as a whole. While Amax > tells us that there is unreliabil- 
ity somewhere in the system, it does not tell us which oscillators are affected. To capture the idea 
of reliability at individual sites, recall that the reliability of the entire system is reflected in the sam- 
ple measures p^ (see Sect. 1.2). By the same reasoning, the reliability at site i is reflected in the 
marginals of /x^ in the variable Oi, we denote this marginal distribution by We say a network 
is reliable at site i if pu),i is concentrated at a single point; the more uniformly distributed these 
projected sample measures are, the greater the site unreliability. These ideas are easily generalized 
to groups of more than one site, but we will treat only single site reliability. 

The following are three standard ways in which the distribution of /x^ j can be described: 

A. Site entropy. For each i and cu, we let H(i, to) denote the entropy of the distribution p^^i, i.e., if 
Poj,i is the density of puj,i with respect to Lebesgue measure on S^, then 
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and we set H{i, u) = — oo if fi^^i is singular. The site entropy H{i) is defined to be the expected 
value of this random variable, i.e., H{i) = J H{i,uj)P{duj). In practice, H{i) is computed as 
limy^oo -f Jq H{i, crt{uj)) dt via the Ergodic Theorem. This number can range from — oo to 0, 
with H(i) = corresponding to uniform distribution and H(i) = — oo corresponding to the 
distribution being singular with respect to Lebesgue measure. A drawback of site entropy is that it 
does not distinguish among singular distributions. 

B. Information dimension. We define 

D{i,Lj) = lim Dk{i,uj) where Dk{i,uj) = ^ — ; . 

fc^oo log k 

In the quantity on the right, 5*^ is divided into k equal intervals, and pj is the probability with 
respect to fx^i,! of finding the phase of oscillator i in the j*^ subinterval. The relevant quantity is 
then D{i) = J D{i,uj)P{duj). This takes values on [0, 1], with D{i) = 1 corresponding to any 
distribution having a density. Information dimension does not, for example, distinguish between 
the uniform distribution on and a distribution supported uniformly on a tiny subinterval of S^. 

C. Cumulative distribution functions (CDFs). The most direct way to assess site distributions is 
to compute the CDF of fx^i,!- This is numerically very simple to do, and is especially effective in 
establishing whether the measure is concentrated at a single point. A drawback of using CDFs is 
that it is not a number. Moreover, to be certain that one is seeing "typical" CDFs, one needs to 
compute them for /i^ j for many values of cu, as CDFs cannot be averaged. 

Above, we discussed various ways to assess /x^ j from a purely theoretical standpoint. Return- 
ing to the situation at hand, recall from Theorem 1 that when A^ax > 0, i.e. when the system is 
unreliable, p^ is a random SRB measure. These measures have densities on complicated families 
of smooth manifolds. In particular, they have dimensions > 1; e.g. in the case of 2 oscillators, 
the dimension of the random SRB measures is 1 + a for some a G (0, 1) where a describes the 
dimension of the fractal part. A well known result in analysis [|24ll tells us that when measures of 
dimensions > 1 are projected onto 1 -dimensional subspaces, the projected measures have a den- 
sity for projections along almost all directions. Now not all projections are "good" in this sense, 
and we cannot be certain that the projection onto any particular site is "good" (projections onto 
sites upstream from where unreliability is produced are obviously not). Still, if the projection to 
site i is good, then Amax > would imply that /i^^ j has a density. This being the case, it is more 
important to be able to compare different distributions with densities than to distinguish different 
singular distributions. We therefore favor site entropy over information dimension as a measure of 
site reliability. 

In this paper, we will use a combination of site entropy and CDFs: If the computed values of 
H{i) appear bounded below, then it is safe to conclude site unreliability, and the closer H{i) is to 
0, the more unreliable. If, on the other hand, the computed values of H{i) appear unbounded, then 
CDFs are used to confirm site reliability. 
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Figure 3: Site distributions for the system ^ with N = 10. Shown are the site-i CDFs for i = 3,7, 10, at 
times t = 500 (solid) and t = 1000 (dash). The parameters are as follows: for the (1,2) subsystem, we set 
ioi = 1, UJ2 = 1.05, ai2 = 1, 021 = 1-18, and e = 1 (so that Amax ~ 0.13). For i > 3, we draw tOi from 
[0.9, 1.1] and aj^j+i from ±[0.6, 1.2]. 

4.2 Sites downstream from unreliable modules 

We now return to the question of propagation of unreliability to sites downstream from an unreli- 
able module. The simplest network with which to investigate this is the A^-chain system 




(8) 



Suppose we choose ai2, a2i, and ei so that the (l,2)-subsystem is unreliable. Notice that no unre- 
liability is produced elsewhere. The question is: will this unreliability be observable downstream, 
at sites i = 3,4, ■ ■ ■ , N, or does it somehow "dissipate?" We run the following numerical experi- 
ment: we set coi = 1, ci;2 = 1-05, ai2 = 1, 021 = 1.05, and £1 = 1, so that the Lyapunov exponent 
Amax of the (l,2)-subsystem is ^ 0.1. For z > 3, we draw randomly (and fix) Ui from [0.9, 1.1] and 
aj i+i from ±[0.6, 1.2]. Computing the site entropie^ H(i) for sites i = 3,7, 10, we find: 



Site 


i = 3 


I = 7 


i = 10 


Entropy H(i) 


-0.4 


-0.2 


-0.01 



To help interpret these numbers, recall that identifying with [0, 1], the entropy of the uniform 
distribution on an interval [a, b] is log(6 — a), and log | ~ —0.7. The data above thus indicate that 
the site distributions are fairly uniform, and in fact seem to become more uniform for sites farther 
downstream. Fig.[3]shows the corresponding CDFs for some sites at representative times; CDFs at 
other sites are qualitatively similar. The graphs clearly show that unreliability propagates. 

We give two explanations for why one should expect this result of propagating site unreliability. 
The first is a plausibility argument along the lines of the projection argument in Sect. 14.11 it is 
possible - but highly unlikely - that the SRB measure would project to point masses in any 

^We compute site entropies by simulating the response of 10, 000 initial conditions to the same realization of the 
stimulus, then applying the "binless" estimator of Kozachenko and Leonenko [TSl (see also ll38l ). 
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of the 8 directions corresponding to the 8 sites downstream. A second, perhaps more intuitive 
explanation, is as follows. Consider site 3 in the system ([8]). Fix a realization of the stimulus, and 
let (6*1, 02, 6*3) denote the 3 phase coordinates. For each choice of (^^i(0), 6*2(0)), the third oscillator 
receives a sequence of coupling impulses from the (l,2)-subsystem. Since the (l,2)-subsystem 
is unreliable, different choices of 9i{0) and 6*2(0) will produce different sequences of coupling 
impulses to oscillator 3, in turn leading to different values of 6^3 (t). This is synonymous with site 
unreliability for oscillator 3. 

What happens if an oscillator receives inputs from more than one source with competing ef- 
fects? The simplest situation is an oscillator driven by both an unreliable module upstream and an 
input stimulus, as depicted in Diagram Note the presence of competing terms: As we have 
just seen, the unreliable module leads to unreliability at site 3. However, the stimulus £3 has a 
stabilizing effect on that oscillator. 

In the results tabulated below, the parameters used are coi = 1, 0^2 = 1.05, 012 = 1, CI21 = 1.15, 
and £1 = 1 (so that the (l,2)-subsystem is again unreliable), 023 = 0.5 and tus = 0.93. The site 
entropy H{3) is computed for various values of £3. We find: 



Stimulus amplitude 


63 = 0.2 


^3 = 1 


63 = 2 


Site entropy H{3) 


-0.4 


-1.2 


-2 



These numbers tell us that at 63 = 0.2, the distribution at site 3 is fairly uniform, and that this 
distribution becomes more concentrated as E3 increases. The CDFs (not shown) confirm this. 
When £3 = 2, for example, about 80% of the distribution /i^ 3 is concentrated on an interval of 
length < 1/5 roughly 70% of the time. These data show that the source of reliability, i.e., the 
stimulus into oscillator 3, attenuates the propagation of unreliability; we call this phenomenon 
interference. Moreover, we find that when £3 is increased further, the support of a large fraction 
of /i(^,3 shrinks to smaller and smaller intervals, decreasing the entropy and reflecting a greater 
tendency to form random sinks in oscillator 3. However, simulations also show that oscillator 3 
does not become fully site reliable even at fairly strong forcing. This is also expected: intuitive 
arguments similar to those above suggest that once created, site unreliability cannot be completely 
destroyed at downstream sites. To summarize: 

Observation 3: Unreliability, once generated, propagates to all sites downstream. 

We finish by clarifying the relation between the material in Sect. 3.3 and this section: 

Propagation versus production of unreliability: The topic of Sect. 4 is whether or not unreli- 
ability created upstream propagates, i.e., whether it can be observed downstream. This concept 
complements an idea introduced in Sect. 3.3, namely the production of new unreliability within a 
module as measured by the positivity of fiber Lyapunov exponents. Mathematically, site reliability 
(or unreliability) is reflected in the marginals of /i^ at the site in question, while the unreliability 
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produced within a module is reflected in the dynamics and conditional measures of /i^ on fibers. 
Naturally, when a module produces unreliability in the sense of Sect. 3.3, its sites will also show 
unreliability in the sense of Sect. 4.1, and one cannot separate what is newly produced from what 
is passed down from upstream. 

5 Examples: reliability and unreliability in small networks 

In [|2T]|. we carried out a detailed study of a coupled oscillator pair. One may seek a similar 
understanding of other small networks, but any classification grows rapidly in complexity with the 
number of sites. In this section, we do not attempt a systematic study, but provide a few examples 
of small networks exhibiting various behaviors. 

In all the examples in this section, Ui E [0.95, 1.05]. 



Our first class of examples is a direct generalization of the 2-loop studied in [|2T|. namely networks 
of "ring" type: 



The main point of this example is to demonstrate that the system above exhibits both reliable and 
unreliable dynamics. Along the way, we also briefly illustrate two interesting phenomena about 
which we have little explanation. 

Example 1 (Amplification effects along loop?) For = 2, 3, ■ ■ ■ , 7, we fix Oi^i+i for i = 
1, • ■ ■ , — 1, and let ajy i vary. Our findings can be summarized as follows: 

(a) With all the aj,j+i ^ 1, the system is reliable for a^^i G [0, 2] and e <2. 

(b) For e = 1 and aj^j+i ~ suitably chosen, the system is unreliable for a^,! G [0.6, 2]. 

Results of numerical simulations for A^ = 7 are shown in Fig. HI For case (a) we randomly choose 
ujj and aj^i+i G [0.95, 1.05] for 1 < j < A^ and 1 < z < A^. For case (b), we start the same way, 
but multiply all the j+i chosen by a constant c. As we tune c from 1 down to 0, we find that in 
each case, pictures similar to that in Fig.|4tb) are produced for a range of c ~ where A^ is the 
size of the ring. Simulations were repeated for different choices of ujj and j+i, to similar effect. 
The exact c's that produce the most unreliable behaviors, however, vary with the choices of ujj and 
is only a rough approximation. 
Details aside, the following trend as A^ increases from 2 to 7 is unmistakable: Given that we 
use roughly equal Oj j+i for 1 < i < A^ and set a^v,! ~ 1^ the values of j+i for which unreliable 
dynamics occur decrease steadily as A^ increases. It is as though coupling effects are amplified 



5.1 The iV-ring 




(10) 
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(a) With a,,i+i ^ 1 (b) With ai,i+i ~ l/N 

Figure 4: Amplification effect in A^-ring, with N = 7. We show the Lyapunov exponent Amax as a function 
of Cat 1- In (a), the coupling constants aj^j+i for i = 1, 2, • • • , — 1 are all f« 1. In (b), they are ^ l/N 
(see text). In both plots, e = 1. 



along the loop, giving rise to an effective coupling "ai jv" ~ 1. (For N = 2, the system is 
known to be most unreliable when ai2 and 021 are roughly comparable; see [21].) Whatever the 
explanation, this A^-ring example promises to be interesting (but we do not pursue it further here). 

Example 2 ( Cancellation effect by couplings of opposite signs?) Given the conjectured amplifica- 
tion effect just described, it is natural to ask whether negative coupling terms along the loop would 
diminish the effects of positive coupling, and vice versa. This idea is validated in simulations. For 
example, for the 4-ring we find (as asserted above) that Amax < when the coupling constants are 
all ^ 1; the plot is qualitatively similar to Fig. I5a). However, if we flip the sign of any one of the 
4 couplings to a value of — 1 while leaving the rest at ^ 1, we then obtain Amax > and plots 
qualitatively similar to Fig. I5b). 

5.2 2-loops driving 2-loops 

Here we study a new situation, in which one unreliable module drives another. Consider the system 

A B 



-3 



(11) 

We think of this network as consisting of two modules: the (l,2)-subsystem as Module A and 
the (3,4)-subsystem as Module B. From [21], we have a great deal of information about these 2- 
oscillator systems individually. Here, we investigate the unreliability produced within Module B 
when driven by Module A. Representing system ([TTI) as a skew product with 2-dimensional fibers 
over a 2-dimensional base (as in Sect. 13.31) . we let A^^x denote the largest fiber Lyapunov exponent 
for Module B. 
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(a) (b) 

Figure 5: The maximum fiber exponent A^ax for Module B in system (fTTI ). as a function of e and 043. In (a), 
the parameters are 012 = 1.1, 021 = 0.8, 023 = 0.5, and 034 = 1. In (b), the parameters are 012 = —1.1, 
021 = —1.2, a23 = 0.95, and 034 = 1. In both cases, we use ui = 1.03, u;2 = 0.98, a;3 = 1, and 
UJ4 = 1.1. Remark on plots: We have chosen the dynamic range in shading the figures to allow meaningful 
comparison of figures; a side effect is that some contour lines may not be visible. We always indicate the 
actual range of values through explicit labels. 

We fix two sets of parameters for which Module A is known to be unreliable. For one set, 
Module A has mutually "excitatory" coupling, with 012,021 > 0; for the other, Module A has 
mutually inhibitory coupling, with 012,021 < 0. We then perform numerical experiments (see 
Fig. [5]) in which we fix 034 = 1 and vary 043 and the system input amplitude e. Our findings are: 

(/) For both choices of parameters for Module A, unreliability is sometimes produced within 

Module B and sometimes not, depending on 043. 
(//) For most values of 034, 043 and e. Module B produces more unreliability (i.e., A^^^ is larger) 
when the oscillators in Module A are mutually inhibitory rather than excitatory. 

Both phenomena appear to be robust. We do not have an explanation for (?'/), and will revisit (?) in 
Sect. 6. 

The situation at £ = is shown in the leftmost column of each of the two panels in Fig. [51 As 
with the 3-ring in Sect. 2.2, A^^x at e = varies sensitively with parameter. The production of 
intrinsic network chaos within Module B is evident for some parameters in both cases. For some 
parameter settings, this chaos is suppressed; see the bottom left panel. Overall, notice the strong 
influence of the e = dynamics of Module B on its tendency to produce unreliability when the 
external stimulus is turned on. 
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6 Modules in isolation versus as part of larger system 



Now that we have discussed both propagation of unreliability between modules and generation 
of unreliability within modules, we return to the strategy suggested in Sect. 13.31 to study the 
reliability of networks by analyzing their component modules separately. An obvious benefit of 
this strategy is that smaller modules are easier to test. However, the strategy will only be successful 
if the reliability of modules in isolation gives a good indication of their reliability when they are 
embedded in larger systems^ 

Pictorially, the problem we face can be represented as follows: 



upstream 
oscillators 



module X 



downstream 
oscillators 



(12) 



Suppose our network can be decomposed into three parts: Module X, which is our module of 
interest, a (possibly large) component upstream from Module X, and a (possibly large) component 
downstream from Module X. The question is: Can the reliability properties of Module X as a 
subsystem of this larger network be predicted by its reliability properties in isolation? 

First we need to clarify what we mean by the "reliability of a module in isolation". We refer 
here to the reliability of the module (without the rest of the network) receiving stimuli with a 
simple, generic statistical structure; in this paper, this statistical structure is taken to be white noise. 
To simulate the correct phase-space geometry, it is important that the white noise be injected in 
a way that mimics network conditions. For example, if oscillators 1, 2, and 4 within Module X 
receive input from the rest of the network, then in analyzing the reliability properties of Module 
X in isolation, we must provide stimuli to the corresponding oscillatorsO One should also use 
comparable forcing amplitudes, although it is less clear what exactly that means. 

At the heart of this question is the following issue: A module embedded in a network may 
receive input from oscillators upstream in the form of coupling impulses; it may also hear directly 
from the external stimuli. Inputs from other oscillators resemble a point process of impulses with 
statistics somewhere between Poisson and periodic; moreover, when an oscillator receives kicks 
from multiple sources, these kicks may be correlated to varying degrees. The question is then 
whether reliability properties of a module are sufficiently similar under these different classes of 
inputs that they can be predicted from studies using white noise stimuli. 

"'This type of issue arises often in coupled nonlinear systems; it is very important yet seldom understood. 

^To illustrate this point, consider a 2-oscillator system with unequal feedback/feedforward couplings: providing 
a stimulus to oscillator 1 leads to horizontal perturbations in 6*2) -space, whereas stimulating oscillator 2 leads 
to vertical perturbations. These two types of perturbations have different relations to the geometry of the intrinsic 
dynamics and can have different effects. 
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Let us return now to the situation depicted in the diagram above. For a quantitative study, 
we first compute Amax for Module X in isolation, subjected to white noise in a suitable range 
of amplitudes. These numbers will be compared to A^*^^ defined as follows: Consider the skew 
product in which the dynamics of the oscillators upstream from Module X are represented in the 
base and the dynamics within Module X are represented on the fibers. (The oscillators downstream 
from Module X are irrelevant.) The number A^^^x the largest fiber Lyapunov exponent (see 
Sect. 13.31 ). The following abbreviated language will be used in the remainder of this paper: when 
we speak of the unreliability produced by a module, we refer to the unreliability produced within 
that module when it operates as a subsystem in the larger network. The same abbreviation applies 
to intrinsic network chaos in a module. 

Proposal: Whether unreliability is produced within Module X, i.e. whether X(^^^ > when e > 0, 
is strongly influenced by 

(a) the reliability properties of Module X in isolation, and 

(b) the intrinsic dynamics within Module X when embedded in the full network, i.e., A^^ at 

£ = 

Part (b) is especially relevant at small e. 

The proposal above is intended to give only a rough indication of the hills and valleys of the 
reliability profile of the module in question; no quantitative predictions are suggested. Part (b) 
of the proposal is largely a statement of continuity: when subjected to weak external stimuli, 
intrinsic network properties come through as expected. The rationale for (a) is that we have seen 
in a number of situations in general dynamical systems theory that the response of a system to 
external forcing depends considerably more strongly on its underlying geometry than on the type 
of forcing, especially when there are elements of randomness in the forcing, e.g. Poisson kicks 
and white-noise forcing have qualitatively similar effects (though purely periodic forcing can do 
peculiar things). A systematic study comparing different types of forcing is carried out in f22\. 

To support our proposal, we present below the results of a study in which the 2-cell system 
studied in [|2T1l . i.e.. 



is used as the embedded module, that is, as Module X in the framework above. The three networks 
used in this study, with Module X enclosed in a dotted line, are: 




Network A: 




Networks: 
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(b) Network A (c) Network B 



Figure 6: Reliability of Module X in isolation and as an embedded subsystem. In (a), we show Amax for 
Module X in isolation. The parameters are loi = I, u>2 = 1.1, and ag = 1. The corresponding modules in 
Networks A and B are given the same parameters. The other parameters are as follows: for Network A, we 
use LOi = 0.97, ai2 = 0.7. For Network B, we draw Ui G [0.95, 1.05] and set 0^,4 = | • (0.6, 0.8, 0.9) and 

ei = £2 = £3 = £■ 
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Network C: 



E-m/^[ 1 



In Networks A and B, the oscillators that feed into Module X are themselves reliable. Network C is 
the system described in Sect. 15.21 as described there, parameters are chosen so that the subsystem 
(1,2) is unreliable. In each case, the feedforward coupling within Module X is set equal to 1, and 
the largest fiber exponent is computed as a function of the feedback coupling and e. Sample plots 
for Networks A and B are shown in Fig. [6l For comparison, we have also included the plot for the 
2-oscillator system in isolation (Fig. 12 in [|2T|| '). i.e. receiving a white noise input of strength e at 
oscillator 1, to mimic the configuration in Networks A-C. Plots for Network C are in Fig. |51 

The resemblance of Figs. [6tb) and (c) to Fig. [6ta) is quite striking given the rather different 
inputs received by the Module X in isolation vs. embedded in Network B. This is evidence in favor 
of part (a) of the proposal above. Network C also gives qualitatively similar reliability profiles, 
although overall it is considerably more reliable for one set of parameters governing oscillators 
(1,2) than the other: see Figs. 5(a) and (b). As suggested by the second part of the proposal, there 
is a strong correlation between all of these overall tendencies and network dynamics at e = 0, 
sensitive as the latter may be. 

Here as in many other simulations not shown, we have found that even though the reliable and 
unreliable regions may shift and the magnitudes of A^'ax "^^Y "^^Y' the general tendency is that the 
reliability of Module X continues to resemble its reliability in isolation, that is, when it receives 
white noise inputs. We take these results to be limited confirmation of our proposal. In sum: 

Observation 4: The reliability profile of the two-oscillator system in isolation found in 1.21 J is a 
reasonable guide to its reliability properties as a module embedded in a larger network. 

It remains to be seen whether this holds for other modules. 



7 An illustrative example 

We finish with the following example, which illustrates many of the points discussed in this paper. 

The network depicted in Fig.|7ta) is made up of 9 oscillators. It receives a single input stimulus 
through oscillator 1 and has "output terminals" at sites 6, 8 and 9 - it is here that we will assess 
the response of the network. We first discuss what to expect based on the ideas above. This is then 
compared to the results of numerical simulations. 

A cursory inspection tells us that this network is acyclic except for the subsystem (4,7). The 
finest decomposition that yields an acyclic quotient, then, is to regard each oscillator as a module 
except for (4,7), which must be grouped together as one. We choose, however, to work with 
a coarser decomposition, in which the (l,2,3,5,6)-subsystem is viewed as Module A, the (4,7)- 
subsystem as Module B, and the (8,9)-subsystem as Module C. Identifying the sites within each of 
these modules produces an acyclic quotient, as shown in Fig.|7];b). 

Since Module B is the only module that is not itself acyclic and hence that is capable of gener- 
ating unreliability, our results from Sect. [3]tell us that Amax for the entire network is < if and only 
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(a) Full network (b) Quotient graph 



Figure 7: Example of a larger network and its quotient graph. In (a), we have labelled the edges with a 
sample of coupling constants. The Ui are drawn from [0.95, 1.05]. 

if no unreliability is produced in Module B. In fact, since there are no freely rotating oscillators in 
the system, we expect Amax to be < if Module B behaves reliably. The behavior of Module B 
hinges a great deal on (i) the couplings a^j and 074, which determine its reliability in isolation, and 
(ii) intrinsic network properties in the two Modules A and B together, esepcially when e is small; 
see Sects. [2land[6l With regard to (i), the reliability profile of the 2-oscillator system complied 
in [i21J is handy. If unreliability is produced in Module B, then we expect to find sites 8 and 9 to 
be unreliable, with a lower reading of site entropy at site 9 than 8 due to the stabilizing effects of 
Module A; see Sect. 4. This is what general theory would lead one to predict. 
We now present the results of simulations. 

First we confirm that Module A alone is reliable as predicted 1^ In addition to the aij given in 
Fig. |71 we randomly drew coupling constants from ±[0.8, 1.2] and frequencies Ui E [0.95, 1.05], 
and find that Amax for Module A ranges from roughly —0.3 to —0.07 when e = 1. Site distributions 
for the sites in Module A are, as predicted, well-localized. For a majority of parameters tested, 90% 
of an ensemble of 10"^ uniformly-chosen initial conditions has collapsed into a cube of side length 

< 10^^ after t=60-110; in all our simulations, the ensemble collapses into a cube of side length 

< 10^^ after t ^ 1000. In particular, the "output terminal" at site 6 is always reliable. 

Turning now to the reliability of Module B, we fixed the coupling constants as shown in Fig.|71 
with tOi E [0.95, 1.05] and e = 1, and ran simulations for the following two sets of parameters: 

(a) 047 = 1, 074 = —0.4: this case is predicted to be reliable 

(b) a47 = 1, a74 = 1.3: this case is predicted to be unreliable 

^All Lyapunov exponents presented in this section have standard errors of < 0.004 as estimated by the method of 
batched means. By the Central Limit Theorem, this means the actual Amax should lie within w 2.5 x 0.004 = 0.01 of 
the computed value with > 99% probabihty. 
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The predictions above are based on the behavior of the two-oscillator network "in isolation" (re- 
ceiving white-noise stimulus of amplitude 1, see (21]), and on the results of Sect. 6. The following 
table summarizes the reliability properties of Module B, both in isolation and when embedded 
within the network: 

Module B Response 





In isolation 


Embedded 

e = 


in network 

e = 1 


(a) 


0-47 = 
0-74 = 


1, 

-0.4 


Amax = -0.07 


A£L = 0.014 


Amax — —0.15 


(b) 


O47 = 
O74 = 


1, 
1.3 


Amax — 0.13 


A4t = 0.076 


A£L = 0.097 



Note that these values are consistent with the Proposal in Sect. [6l the behavior of the module at 
e = 1 when embedded within the network is effectively determined by its behavior in isolation. 
Furthermore, by Prop. 13. 5i we know the Lyapunov exponent Amax of the entire network is equal to 
A;t!L of Module B in case (b), and is > A£,*L in case (a). 

Finally, we study site distributions at sites 8 and 9. In case (a), we find again that computed 
site distributions are well localized. In case (b), we find the expected evidence of propagated 
unreliablility and interference, with H{8) = —0.3 and H{9) = —0.7. 

In summary, the results of our simulations are entirely consistent with predictions based on the 
ideas developed in this paper. 

Conclusions 

Understanding and predicting the reliability of responses for a general network is a daunting task. 
In this paper, we have limited ourselves to the simplest intrinsic dynamics, namely those of phase 
oscillators with pulsatile coupling. In this context, we believe we have raised and addressed a few 
basic issues for an interesting class of networks. Our main findings are: 

1. Acyclic networks, i.e., networks with a well defined direction of information flow, are 

(a) never chaotic in the absence of inputs, and 

(b) never unreliable when external stimuli are presented. 

2. The mathematical analysis of the acyclic case can be extended to treat networks with a mod- 
ular decomposition and acyclic quotient, i.e., networks for which the nodes can be grouped 
into modules, with inter-module connections being acyclic. These networks are fully capable 
of reliable and unreliable dynamics. 

3. For networks with a nontrivial module decomposition, production of unreliability can be 
localized to specific modules, and is indicated by positive fiber Lyapunov exponents. 
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4. Once it is produced, unreliability will propagate: it can be attenuated but not completely 
removed; without intervention it actually grows for sites farther downstream. 



5. There is evidence that the reliability of a module in isolation may give a good indication of 
its behavior when embedded in a larger network. If true, this would simplify the analysis of 
networks that decompose into relatively simple modules with acyclic connections. 

A general understanding of the issue in item 5 is not yet in sight, but our limited testing - using the 
2-oscillator module studied in the companion paper ETI - produced encouraging results. 

We hope that the findings above will be of some use in concrete applications in neuroscience 
and other fields. 
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